TITLE OF THE INVENTION 

IMAGE PROCESSING APPARATUS AND METHOD, IMAGE PROCESSING 
PROGRAM, AND STORAGE MEDIUM 

5 

This patent specification is based on Japanese patent 
applications, No. 2003-076389 filed on March 19, 2003 and No. 
2003-167090 filed on June 11, 2003 in the Japanese Patent 
Office, which are hereby incorporated by reference in its 
10 entirety. 

FIELD OF THE INVENTION 
The present invention relates to an image processing 
apparatus, and more particularly, to an apparatus for 
15 correcting distortion of scanning an image of a page into a 

photocopier or scanner when the page cannot be laid flat on a 
scanning bed. 

BACKGROUND OF THE INVENTION 
20 When a flat bed scanner is used to scan bindings of 

thick documents such as a book and a magazine as shown in Fig. 
1, a binding portion 41 of a book document 40 is scanned such 
that the binding portion 41 cannot be laid flat on a contact 
glass 2 of an image reading apparatus 1. In Fig. 1, the 
25 binding portion 41 of the book document 40 is laid on the 

contact glass 2 substantially in parallel to a main scanning 
direction. When the binding portion 41 of the book document 
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40 rises above the contact glass 2, the binding portion 41 is 
away from a focal point of the scanner, so that both ends of 
a binding boundary line of the book document 40 are distorted 
and a scanned image shrinks in the main scanning direction 
5 and sub-scanning directions as shown in Fig. 2. 

As shown in Fig. 1, the image reading apparatus 1, 
configured as part of a digital copier 16, includes a 
pivotable platen 17 and a sensor 18. The platen 17 contacts 
a document to the contact glass 2. The sensor 18 detects an 

10 opening and closing of the platen 17. A document scale 11 

determines a position for placing a document and adjusts the 
contact glass 2. 

As shown in Fig. 2, various technologies are proposed 
for correcting a distortion by expanding a distorted, scanned 

15 image in main and sub-scanning directions. 

Japanese Laid-Open Patent Publication No. 2002-358514 
describes a method for checking curvatures of straight lines 
such as a book outline (i.e., a page outline), a ruled line, 
and a character line in a document, measuring a magnification 

20 for correcting the curvatures to original straight lines, and 
expanding the curvatures in the main scanning direction. 

In a correction in the sub-scanning direction, when a 
location in the main scanning direction of an optical axis 
passing through a center of a lens of a scanner and a 

25 distance from the lens to a contact glass are determined, a 
distance from the contact glass 2 to a height of the book 
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document 40 is determined so that a three dimensional 
position is identified. Using information about the three 
dimensional position allows for expanding in the sub-scanning 
direction . 

5 In addition, Japanese Laid-Open Patent Publication No. 

2002—247643 describes a method for use in a ratio of a 
rectangular width and height circumscribing a character in a 
scanned image when a location in the main scanning direction 
of an optical axis passing through a center of a lens of a 

10 scanner and a distance from the lens to a contact glass are 
not determined. 

Presently, the above-mentioned techniques, however, 
possess their own distinct disadvantages. Users who require 
a distortion correction cannot perform a process of a 

15 correction, causing a longer processing time and a lower 

correction image quality. In addition, after the process of 
correction is completed, a corrected image often has a 
different size from an original document. 

20 SUMMARY OF THE INVENTION 

In one embodiment, a novel image processing apparatus 
which includes an image reading apparatus includes a first 
memory, a book image corrector, and a selector. The first 
memory stores optical positioning information of the image 

25 reading apparatus. The book image corrector performs an 

image correction based on reference data from an image read 

3 

1742326 v3; 1 1CDY03I.DOC 



by the image reading apparatus when the image is of a book 
document. The selector selects one of the plurality of 
different correction modes of the second corrector based on 
the optical positioning information stored in the first 
5 memory. The book image corrector includes a first corrector 
and a second corrector. The first corrector corrects in a 
main scanning direction a distortion of the image of the book 
document based on the reference data. The second corrector 
having a plurality of different correction modes corrects a 

10 distortion of the image of the book document in a sub- 
scanning direction. 

The reference data may include a page outline, a ruled 
line, and a character line. 

The book document may be laid on the image reading 

15 apparatus such that a binding portion of the book document is 
parallel to the main scanning direction. 

The plurality of different correction modes may include 
a first mode and a second mode. The first mode may correct a 
rising amount of an image portion of the image of the book 

20 document in a vicinity of the binding portion. The second 
mode may extract a character circumscribing rectangle from 
the image of the book document and correct the distortion 
based on a rectangle aspect ratio of the character 
circumscribing rectangle. The selector may select the first 

25 mode when the optical positioning information is stored in 
the first memory and the second mode when the optical 
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positioning information is not stored in the first memory. 

The image processing apparatus may further include a 
second memory storing a user selection mode. In the image 
processing apparatus, the selector may select another one of 
5 the plurality of different correction modes which does not 
perform a distortion correction when the optical positioning 
information is not stored in the first memory. 

The image processing apparatus may further include a 
second memory storing a user selection mode. In the image 

10 processing apparatus, the selector may select a different one 
of the plurality of different correction modes which does not 
perform a correction of the distortion in the sub-scanning 
direction, regardless of whether the optical positioning 
information is stored in the first memory. 

15 Further, in one embodiment, a novel image processing 

apparatus which includes an image reading apparatus includes 
an image designating mechanism, a reference data extractor, 
and a book image corrector. The image designating mechanism 
designates a type of image of book document from the image 

20 reading apparatus. The reference data extractor extracts 
reference data obtained by the image of the book document. 
The book image corrector extracts reference data from an 
image read by the image reading apparatus, analyzes the image, 
and performs an image correction when the image is determined 

25 as an image of a book document according to an analysis 

result. The book image corrector includes a first corrector 
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and a second corrector. The first corrector corrects in a 
main scanning direction a distortion of the image of the book 
document based on the reference data extracted from the image 
of the book document. The second corrector having a 
5 plurality of different correction modes corrects a distortion 
of the image of the book document in a sub-scanning direction. 
In the image processing apparatus, the reference data 
extractor extracts the reference data based on the type of 
image designated by the image designating mechanism. 

10 The reference data may include a page outline, a ruled 

line, and a character line. 

The book document may be laid on the image reading 
apparatus such that a binding portion of the book document is 
parallel to the main scanning direction. 

15 The reference data extractor may extract the ruled line 

and the character line other than the page outline as the 
reference data when the image designating mechanism 
designates a binary image. 

Further, in one embodiment, a novel image processing 

20 apparatus which includes an image reading apparatus reading a 
book document having a binding portion includes an image 
distortion corrector and an image adjustor. The image 
distortion corrector performs a distortion correction of an 
image of a book document read by the image reading apparatus. 

25 The image adjustor adjusts an image of the book document 

after the process of the distortion correction is completed. 
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The book document may be laid on the image reading 
apparatus such that a binding portion of the book document is 
parallel to the main scanning direction. 

The image adjustor may centrally align the binding 
5 portion of the book document to the image after the process 
of the distortion correction is completed. 

The image adjustor may equally adjust a size of the 
corrected image to a size of the book document. 

The image adjustor may centrally align the binding 
10 portion of the corrected image and equally adjust a size of 
an output image to the book document. 

The image processing apparatus may further include an 
instructing mechanism which instructs an adjustment of a 
corrected image. In the image processing apparatus, the 
15 image adjustor may adjust the image based on an instruction 
of the instructing mechanism. 

Further , in one embodiment , a novel image processing 
method includes the steps of storing, reading, extracting, 
analyzing, selecting, and performing. The storing step 
20 stores optical positioning information of an image reading 
apparatus. The reading step reads an image of a book 
document. The extracting step extracts reference data from 
an image read by the reading step. The analyzing step 
analyzes the image. The selecting step selects one of a 
25 plurality of different correction modes based on the optical 
positioning information stored in the storing step. The 
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performing step performs an image correction when the image 
is determined as an image of a book document according to an 
analysis result performed by the analyzing step. In the 
image processing method, the performing step includes the 
5 steps of first correcting and second correcting. The first 
correcting step corrects in a main scanning direction a 
distortion of the image of the book document based on the 
reference data extracted from the image of the book document. 
The second correcting step corrects a distortion of the image 

10 of the book document in a sub-scanning direction. 

The reference data may include a page outline, a ruled 
line, and a character line. 

The book document may be laid on the image reading 
apparatus such that a binding portion of the book document is 

15 parallel to the main scanning direction. 

The plurality of different correction modes may include 
a first mode and a second mode. The first mode may correct a 
rising amount of an image portion of the image of the book 
document in a vicinity of the binding portion. The second 

20 mode may extract a character circumscribing rectangle from 
the image of the book document and correct the distortion 
based on a rectangle aspect ratio of the character 
circumscribing rectangle. The selecting step may select the 
first mode when the optical positioning information is stored 

25 in the storing step and the second mode when the optical 

positioning information is not stored in the storing step. 
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The image processing method may further include a 
memorizing step of storing a user selection mode. In the 
image processing method, the selecting step selects another 
one of the plurality of different correction modes which does 
5 not perform a distortion correction when the optical 

positioning information is not stored in the storing step. 

The image processing method may further include a 
memorizing step of storing a user selection mode. The 
selecting step may select a different one of the plurality of 

10 different correction modes which does not perform a 

correction of the distortion in the sub-scanning direction, 
regardless of whether the optical positioning information is 
stored in the storing step. 

Further, in one embodiment, a novel image processing 

15 method includes the steps of designating, reading, extracting, 
selecting, and performing. The designating step designates a 
type of image of book document from an image reading 
apparatus. The reading step reads an image of the book 
document. The extracting step extracts reference data 

20 obtained by the image of the book document. The selecting 

step selects one of a plurality of different correction modes 
based on the optical positioning information stored in the 
storing step. The performing step performs an image 
correction when the image is of a book document. The 

25 performing step includes the steps of first correcting and 
second correcting. The first correcting step corrects in a 
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main scanning direction a distortion of the image of the book 

document based on the reference data extracted from the image 

of the book document. The second correcting step corrects a 

distortion of the image of the book document in a sub- 
5 scanning direction. The extracting step may extract the 

reference data based on the type of image designated by the 

designating step. 

The reference data may include a page outline, a ruled 

line, and a character line. 
10 The book document may be laid on the image reading 

apparatus such that a binding portion of the book document is 

parallel to the main scanning direction. 

The extracting step may extract the ruled line and the 

character line other than the page outline as the reference 
15 data when the image designating mechanism designates a binary 

image . 

Further , in one embodiment, a novel image processing 
method includes the steps of performing and adjusting. The 
performing step performs a distortion correction of an image 
20 of a book document read by an image reading apparatus. The 
adjusting step adjusts an image of the book document after 
the process of the distortion correction is completed. 

The book document may be laid on the image reading 
apparatus such that a binding portion of the book document is 
25 parallel to the main scanning direction. 

The adjusting step may centrally align the binding 
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portion of the book document to the image after the process 
of the distortion correction is completed. 

The adjusting step may equally adjust a size of the 
corrected image to a size of the book document. 
5 The adjusting step may centrally align the binding 

portion of the corrected image and equally adjust a size of 
an output image to the book document. 

The image processing method may further include an 
instructing step of instructing an adjustment of a corrected 

10 image. The adjusting step may adjust the image based on an 
instruction of the instructing step. 

Further, in one embodiment, a novel program of an image 
correction causing a computer to execute an image correction 
according to a method includes the steps of storing, reading, 

15 extracting, analyzing, selecting, and performing. The 

storing step stores optical positioning information of an 
image reading apparatus. The reading step reads an image of 
a book document. The extracting step extracts reference data 
from an image read by the reading step. The analyzing step 

20 analyzes the image. The selecting step selects one of a 

plurality of different correction modes based on the optical 
positioning information stored in the storing step. The 
performing step performs an image correction when the image 
is determined as an image of a book document according to an 

25 analysis result performed by the analyzing step. The 

performing step includes the steps of first correcting and 
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second correcting. The first correcting step corrects in a 
main scanning direction a distortion of the image of the book 
document based on the reference data extracted from the image 
of the book document. The second correcting step corrects a 
5 distortion of the image of the book document in a sub- 
scanning direction . 

Further , in one embodiment , a novel computer readable 
medium storing a program makes it possible to perform image 
correction in an efficient 4 manner by executing the method 
10 according to any one of the embodiments described above. 

BRIEF DESCRIPTION OF THE DRAWINGS 
A more complete appreciation of the disclosure and many 
of the attendant advantages thereof will be readily obtained 
15 as the same becomes better understood by reference to the 

following detailed description when considered in connection 
with the accompanying drawings , in which: 

Fig. 1 is a perspective view of a scanned book 
document; 

20 Fig. 2 is an explanatory view of a distorted portion of 

a scanned image; 

Figs. 3A and 3B are schematic views illustrating a 

correction of a distorted and scanned image of a booklet in a 

main scanning direction according to the present invention; 
25 Figs. 4A and 4B are schematic views illustrating when a 

horizontal line is extracted from a vertically written 
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character and a correction in a main scanning direction is 
performed; 

Figs. 5A and 5B are schematic views of a correction in 
a sub-scanning direction when a scanner parameter is unknown; 
5 Figs. 6A and 6B are schematic views of a correction in 

a sub-scanning direction when a scanner parameter is known; 

Figs. 7A - 7D are schematic views illustrating when a 
corrected image varies in size and a book region is stored in 
an input image region after a correction process is 
10 completed; 

Figs. 8A - 8D are schematic views illustrating when a 
corrected image varies in size and a book region protrudes 
from an input image region after a correction process is 
completed; 

15 Fig. 9 is a block diagram of a function performed in 

the image processing apparatus of the present invention; 

Fig. 10 is a hardware configuration implementing the 
image processing function of the present invention; 

Fig. 11 is a schematic flowchart of an image distortion 
20 correction process for a scanned image according to the 
present invention; 

Fig. 12 is a flowchart illustrating a detailed 
description of a reference line searching according to the 
present invention; 
25 Fig. 13 is a flowchart illustrating a detailed 

description of an image distortion correction in a main 
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scanning direction according to the present invention; 

Fig. 14 is an explanatory view of an image distortion 
correction of a scanned image in a main scanning direction 
according to the present invention; 

Fig. 15 is a flowchart illustrating a detailed 
description of an image distortion correction in a sub- 
scanning direction according to the present invention; 

Fig. 16 is an explanatory view calculating a height 
between a contact glass and an original document according to 
the present invention; and 

Fig. 17 is a flowchart illustrating a detailed 
description of a size correction. 

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 
In describing the preferred embodiments illustrated in 
the drawings, specific terminology is employed for the sake 
of clarity. However, the disclosure of this patent 
specification is not intended to be limited to the specific 
terminology selected, and it is to be understood that each 
specific element includes all technical equivalents that 
operate in a similar manner. Referring now to the drawings, 
wherein like reference numerals designate identical or 
corresponding parts throughout the several views, 
particularly to Figs. 3A and 3B, an exemplary image 
correction according to a preferred embodiment of the present 
invention is now described. 
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Figs. 3A and 3B are schematic views illustrating a 
correction of a distorted and scanned image of a booklet in a 
main scanning direction. 

An image scanned by an image reading apparatus 101 
5 (Fig. 9) generally includes a page contour (i.e., an outline), 
a ruled line, and a horizontally written character. The page 
outline is sometimes not clearly scanned depending on an open 
or closed status of a platen and the placement of a document. 
In addition, a ruled line is not always included in the 

10 document. However, a horizontal line in the document is a 
strong clue to correct a distortion. 

When a curved horizontal line as shown in Fig. 3A or a 
horizontal virtual line such as a character line is corrected 
as shown in Fig. 3B, at least a distortion in the main 

15 scanning direction (i.e., a vertical direction in the 

drawing) is corrected. Specifically, the page outline, the 
ruled line, and the character line in the scanned image are 
extracted such that each line is expanded in a mutually 
parallel direction . 

20 Since the image reading apparatus 101 (Fig. 9) cannot 

precisely scan a character and an image in a vicinity of the 
page outline (i.e., within approximately 2 mm), a correction 
using the ruled line and the character line is required 
without using the page outline. Further, when an original 

25 document has a binary image, it is preferable not to use a 
page outline for an image scanning. 
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Figs. 4A and 4B are schematic views illustrating when a 
correction is performed in the main direction by extracting a 
horizontal line from a vertically-written character line. 
Lines horizontally joining a beginning and an end of each 
5 line are extracted. 

The horizontal virtual line extracted from the page 
outline, the ruled line, and the character line are 
hereinafter referred to as a reference line. 

A correction in the sub-scanning direction depends on 

10 whether a scanner parameter (i.e., a position of an optical 
axis of a scanner lens and a distance between the center of 
the lens and a contact glass) is known or unknown. 

Figs. 5A and 5B are schematic views of a correction in 
a sub-scanning direction when a scanner parameter is unknown. 

15 A character circumscribing rectangle is extracted from the 
scanned image after the correction in the main scanning 
direction is completed. The character circumscribing 
rectangle is well-known in character recognition technology. 
Fig. 5A is a schematic view illustrating an extracted 

20 character circumscribing rectangle. That is, the rectangle 

near a binding portion has a horizontal length shorter than a 
vertical length. This means that the rectangle shrinks in 
the sub-scanning direction. When the scanner parameter is 
unknown, an image is divided into a portrait region in the 

25 form of bars or strips and is expanded in the sub-scanning 
direction so that an average of a width and depth of the 
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character circumscribing rectangle in each portrait region is 
equal (see Fig. 5B) . 

In the Japanese writing system, there are two character 
sizes, single-width and double-width characters. Single- 
5 width characters represent numbers and alphabets. Double- 
width characters represent "kana" (i.e., Japanese system of 
syllabic writing) and "kanji" (i.e., Chinese characters). 
When a document is scanned, the scanned image includes an 
undistorted portion having a double-width character and a 

10 portion in a vicinity of a binding having a single-width 

character. In this case, the single-width character tends to 
be expanded to the double-width character. In order to avoid 
this, a correction in the sub-scanning direction is not 
required when a parameter is unknown. 

15 Figs. 6A and 6B are schematic views illustrating a 

correction in a sub-scanning direction when a scanner 
parameter is known. Fig. 6B shows the A-B section in an 
uncorrected scanned image illustrated in Fig. 6A. When a 
scanner parameter is known, a height h (i.e., a rising 

20 amount) is obtained from a distance from the contact glass to 
a surface of the original document depending on a curvature 
of the reference lines such as the page outline, the ruled 
line, and the character line. As shown in Fig. 6B, one pixel 
in a sub-scanning direction is expanded by m times and is 

25 increased in this way. One exemplary approach is described 
in Japanese Laid-Open Patent Application Publication No. 
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2003-076389. 

Figs. 7A - 7D and 8A - 8D are schematic views 
illustrating variations in a shape of each image when an 
input image is corrected. In an image output, it is 
5 preferable to select whether or not the input image has the 
same size as an output image. When the input image does not 
have the same size as an output image, an image having a 
corrected book region is output (see Figs. 7C and 8C) . When 
the input image has the same size as an output image, an 

10 image having a corrected book region is reallocated in an 
input image region and output (see Figs. 7D and 8D) . At 
this time, a corrected binding position coincides with a 
center line in parallel to a main scanning direction of an 
input image region. Subsequently, protruding portions of the 

15 corrected book region are removed from the input image region. 
Fig. 7D shows an example of the corrected book region 
included in the input image region. Fig. 8D shows an example 
of the corrected book region protruding from the input image 
region. 

20 A structure of an image processing apparatus of the 

present invention to perform the above-mentioned image 

processing will now be described. 

Fig. 9 is a block diagram illustrating a function which 

is performed in the image processing apparatus 100 of the 
25 present invention. In Fig. 9, an image input section 71 

receives a scanned image having a distorted binding part from 
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the image reading apparatus 101, such as a scanner. In 
addition, the image input section 71 receives a scanned image 
not only from the image reading apparatus 101 such as a 
scanner, but also from a network or a hard disk (not shown) . 
5 An image analyzer 72 analyzes the scanned image to extract 
the above-mentioned reference line. 

A reference line such as the page outline, the ruled 
line, and the character line can be extracted by converting 
the scanned image into a black dot histogram having a binary 

10 image. Since these techniques are well-known in the art, the 
detailed description thereon is omitted. 

A main scanning direction corrector 73 (i.e., a first 
corrector) and a sub-scanning direction corrector 74 (i.e., a 
second corrector) use the above-mentioned method to correct 

15 distorted images. Alternatively, a book image corrector 

including the main scanning direction corrector 73 and the 
sub-scanning direction corrector 74 may be provided to 
correct distorted images. A size corrector 75 aligns a 
binding portion of an image to the center line after a 

20 correction process is completed. The size corrector 75 also 
adjusts an image size. An image output section 76 outputs a 
corrected image to a printer engine, a network, and a hard 
disk, which are not shown in the figure. 

An instructing section 77 captures an image input from 

25 an input instructing section 78 such as a touch panel and the 
like. The instructing section 77 also stores instruction 

19 

, 1742326 v3; 11CDY03I.DOC 



data of each process such as an image distortion correction, 
a size correction, and an image output to a processing mode 
storage 80 (i.e., a second memory). The instructing section 
77 stores information about a scanner described as a scanner 
5 parameter into a scanner information storing section 7 9 (i.e., 
a first memory) to reference the information as desired. The 
scanner information storage 79 is preferably formed with 
memory such as a nonvolatile random access memory (RAM) whose 
contents are saved when a device is turned off. It should be 

10 understood that the scanner parameter is a unique numerical 
value to the image reading apparatus 101 (i.e., a scanner 
101) so that the scanner parameter may be set when a scanner 
101 connects to the image processing apparatus 100. 

Fig. 10 shows a hardware configuration implementing the 

15 image processing function shown in Fig. 9. As shown in Fig. 
10, the image processing apparatus 100 has a CPU (central 
processing unit) 31 which centrally controls components 
connected to it. This CPU 31 is connected to a ROM (read only 
memory) 32 which stores BIOS, and so on, a RAM (random access 

20 memory) 33 which serves as a work area for the CPU 31 , and a 
bus 34. These components comprise a micro computer. Further, 
the bus 34 is connected to a HDD 35 which stores a control 
program, a CD-ROM (Compact Disc) drive 36 which reads a CD- 
ROM 37 and an interface (I/F) 38 through which the CPU 31 

25 communicates with the printer part and a network. 

The CD-ROM 37 as shown in Fig. 10 is one of the 
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recording media of the present invention and stores a 
predetermined control program. The CPU 31 reads the control 
program stored on the CD-ROM 37 through the CD-ROM drive 36 
and then installs it to the HDD 35. This program enables the 
5 main control unit 100 to perform various processes which are 
described later. Further, it is possible to use various 
kinds of optical discs such as DVD 1 s , various kinds of 
magnet-optical discs, various kinds of magnet discs such as 
flexible discs, various kinds of semiconductor memories, and 

10 so on, as well as the CD-ROM 37 as the recording media. It 
is also possible to install the program, which is downloaded 
through networks such as the Internet, to the HDD 35. In 
this case, the recording media which store the programs on a 
server side are also the recording media for recording image 

15 processing programs according to the present invention. The 
program may be executed under a predetermined OS (Operating 
System) or the OS may execute a part of the processes in the 
program, as described later. Further, the program may be 
included in a group of program files which construct 

20 application programs such as word processing software and an 
operating system, and so on. 

Processes which are executed by the CPU 31 provided in 
the image processing apparatus 100 under the control of the 
control program will now be described. 

25 Fig. 11 shows a schematic flowchart of the distortion 

correction process for the scanned image according to the 
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present invention. After a process of correction is 
completed, step S90 performs processing mode instructions 
such as an image scan method, a reference line extraction 
method, a correction in a sub-scanning direction, and an 
5 image alignment. For example, when a scanner 101 connected 
to an image processing apparatus 100 scans an image, a scan 
option is used to select a color mode or monochromatic mode. 
When the scanned image is monochromatic, a binary image or a 
multi-value image is specified. In practice, instructions 

10 such as a resolution and a scan region are required. However, 
the description is limited primarily to sections to which the 
present invention is related. 

When a reference line is extracted, an extraction of a 
page outline, a correction of a sub-scanning direction, a 

15 center-aligned image after a process of correction is 

completed, and an output same size as an original document 
are instructed. In this step, the processing mode is 
initially set, however, it may be set in the middle of the 
process other than information scanned by the scanner. 

20 In step S91, the scanned image is input. Alternatively, 

it is also possible to input the scanned image from an image 
file which has already been scanned. In this case, scanner 
information is not included in the image file so that the 
scanner parameter is not used to correct the image. In step 

25 S92, a reference line is extracted. In step S93, the 

extracted reference line is used to perform a correction of 
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the image in a main scanning direction. In step S94, the 
correction of the image in a main scanning direction is 
checked. In step S95, if a correction is instructed, a 
correction of the image in a sub-scanning direction is 
5 performed. In step S96, if a correction is not instructed, a 
size correction is performed without the correction in a sub- 
scanning direction. The correction result is stored in a 
hard disk or is sent to a printer engine for printout. 
Fig. 12 is a flowchart illustrating a detailed 
10 description of a reference line searching (step S92) in Fig. 
11. 

If a binary image is selected in a processing mode (Yes 
in step S100) , or if a page outline is not selected (No in 
step S101) , the process proceeds to a ruled line extraction 

15 (step S104) without the process of a page outline extraction. 
Otherwise, the page outline is selected (step S102) . 
Alternatively, the scanned image of a page outline, a ruled 
line, and a character line may be previously converted into a 
binary image to produce a histogram of a black pixel in each 

20 main scanning direction, which are not shown in this 

flowchart. Since the reference line is a vertical line 
against a binding portion (i.e., in a main scanning 
direction) , a long straight line represents a high frequency 
in the histogram. When a top and bottom outline of a page is 

25 extracted (Yes in step S103) , the process is completed and 
returns to a start position. In this step, if two lines of 
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the page outline are not extracted, one line may be extracted. 
Then, the process stores information about the extracted 
outline position and returns to the start position. This 
completes the process of the reference line extraction. 
5 Next, a correction in a sub-scanning direction will be 

described. Fig. 13 is a flowchart illustrating a detailed 
description of a correction in a main scanning direction 
(step S93) in Fig. 11. 

Control begins in step S110 in which a determination is 

10 made whether the reference line is extracted. If the 

reference line is not extracted, a correction is not made so 
that the process is completed. If the reference line is 
extracted, an extended line of a line portion of the 
reference line is determined (step Sill) . If two reference 

15 lines are extracted and two extended lines of which are 
determined (Yes in step S112), the process proceeds to an 
expansion process (step S114). If one reference line is 
extracted, another reference line is added (step S113) . 

In order to add a reference line, a line parallel to a 

20 binding passing a center line of the scanned image may be 

added. Alternatively, locus in a sub-scanning direction at a 
center position of a lens may be used. Since a straight line 
is added, the extended line needs not be determined. 

Next, in step S 114, an extension process of the image 

25 in a main scanning direction is performed. Fig. 14 is an 
explanatory view of an image distortion correction of a 
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scanned image in a main scanning direction. In Fig. 14, 
reference lines 1 and 2, prior to a correction process, are 
represented by solid lines. Reference lines 1 and 2, after a 
correction, are represented by dotted lines. The dotted 
5 lines, after a correction, are lines at which a straight line 
portion (i.e., a flat portion) of the reference lines 1 and 2 
prior to the correction is extended. In a position X in a 
sub-scanning direction, a point P on the reference line 1 is 
corrected to a point P' . A point Y on the reference line 2 
10 is corrected to a point Y' . When an arbitrary point Y in a 

main scanning direction in the position X is corrected to Y' , 
the following relationship is obtained. 
YP/YQ=Y 1 P 1 /Y'Q' 

Therefore, when a position of each point in the main 
15 scanning direction is a point P, the point P is represented 
as P(y) to obtain the following equation. 
(Y(y)-P(y) )/(Y(y)-Q(y) )= 
(Y» (y)-P' (y))/(Y' (y)-Q' (y) ) 

The above-equation is rearranged as follows. 
20 Y(y)= 

( (P(y)-Q(y) )/(P' (y)-Q' (y) ) )Y' (y)+(P f (y)Q(y)- 
P(y)Q' (y) )/(P f (y)-Q' (y) ) 

A pixel value of a position Y(y) prior to the 
correction is set to a pixel value of a position Y' (y) after 
25 the correction. 

This represents a method for correcting the distortion 
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in the main scanning direction. 

Referring now to Fig. 15, a correction in a sub- 
scanning direction will be described. 

Fig. 15 is a flowchart illustrating a detailed 
5 description of the correction in the sub-scanning direction 
(step S95) in Fig. 11. Control begins in step S130 in which 
a determination is made whether a scanner parameter is set to 
a scanner information storage 79. When the answer is Yes in 
Step 130, a height between the contact glass and the original 
10 document is calculated in all sub-scanning directions of 
curving reference lines. The height between the contact 
glass and the original document is calculated from optical 
positioning information shown in Fig. 16. Although Fig. 16 
is inverted relative to an ordinary scanner, Fig. 16 shows a 
15 relationship between an arbitrary position and a virtual 

position of the original document in a sub-scanning direction. 
In Fig. 16, when the original document is floated by T, the 
image originally positioned at a point Ka is seen at a point 
A3 which is inside by a distance of X. This is because the 
20 image in a main scanning direction is obtained using a lens. 
When a scanner parameter (i.e., a position Ak of an optical 
axis and a focus plane distance) is determined, the following 
equation is obtained from Ka and A3. 
(A3-Ak) /{ (Ak-Ka) - (A3-Ak) } 
25 where T = a focus plane distance. 

When thus-determined height between the contact glass 
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and the original document is expanded to the plane as shown 
in Fig. 6B, the expansion process is performed based on the 
height between the contact glass and the original document 
(step S132) . 

5 On the other hand, when scanner information is not 

determined (No in step S130), the character circumscribing 
rectangle is extracted (step S133) . An extraction process is 
performed based on a rectangle aspect ratio (in step S134) . 
Further details for the above-mentioned extraction process 
10 are described in Japanese Laid-Open Patent Publication No. 
2002-358514 . 

The image after a correction of a distortion is 
completed include some errors except where a complete 
correction is performed. The errors are caused by 

15 misalignments of a binding portion (i.e., a center line) and 
a difference between an original document and an image size. 
Fig. 17 is a flowchart illustrating a detailed description of 
a ; size correction (step S96) in Fig. 11. When a central 
alignment is instructed by an instruction of the size 

20 correction stored in the processing mode storage 80 (Yes in 

step S140), the image is moved such that a binding portion of 
an original image is centrally aligned to an output image 
(Step 141) . If an instruction is performed so as to output 
the same size as an original document (Yes in step S142), a 

25 protruding portion is removed (step S143) . Alternatively, 

the above-mentioned instruction may be performed in, e.g., an 
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adjustment mode for adjusting a size and a central alignment 
at the same time. 

This specification may be conveniently implemented 
using a conventional general purpose digital computer 
programmed according to the teachings of the present 
specification, as will be apparent to those skilled in the 
computer art. Appropriate software coding can readily be 
prepared by skilled programmers based on the teachings of the 
present disclosure, as will be apparent to those skilled in 
the software art. The present specification may also be 
implemented by the preparation of application specific 
integrated circuits or by interconnecting an appropriate 
network of conventional component circuits, as will be 
readily apparent to those skilled in the art. 

Numerous additional modifications and variations are 
possible in light of the above teachings. It is therefore to 
be understood that within the scope of the appended claims, 
the disclosure of this patent specification may be practiced 
otherwise than as specifically described herein. 
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